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ABSTRACT 

A two-year evaluation of an experience-based 
curriculum in bilingual education is described in parable style* The 
proposal for this research design was developed around the question 
of fijrst-hand field experiences. A review of the first-year project 
evealed some of its weaknesses and reasons for poor results* For the 
second year^ the public school constraints were taken into 
consideration, a training session for school personnel was conducted, 
and a research design was planned by all staff and researchers to be 
involved in it* The design was fairly complex because of the public 
school constraint that no child ever be denied the "benefits" of a 
program* Two consecutive grade levels at each school were assigned 
randomly to each of three treatment, groups? called full, partial and , 
delayed treatment* Results indicated that students in the full 
treatment group performed better than students in the partial 
treatment group, who in turn performed better than those in the 
delayed treatment group* Advantages were evident in both Spanish and 
English communication skills* Appendices cover teacher competencies 
in a bilingual program; parental involvement strategies; and 
description, analysis and results of the experience-based curriculum 
project* (AHH) 
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CAN RESEARCHERS FIND TRUE HAPPINLS*5 IN A PUBLIC SCHOOL SETTING? 
-4* A SUCCESS STORY IN BILINGUAL EDUCATION EVALUATION 

ABTRACT 



After several attempts at intituting research designs in 
the public school setting, the authors have found that 
given a 'certain set of ingredients including a U.S.. Office 
of Education mandate and a training program for school and 
project staff one effort has succeeded. This effort was 
the investigation of a field-trip based curriculum for 
bilingual education. The design still had to meet public 
school constraints that led to a fairly complex design 
which is described in detail. However, the project ended 
the 1976-77 school year with a success. 

The narrative of the paper is written in the style of a 
parable with more technical appendices attached. 
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CAN RESEARCHERS FIND TRUE HAPPINESS IN A PUBLIC SCHOOL SETTING? 
A SUCCESS STORY IN BILINGUAL EDUCATION EVALUATION 



OVERVIEW 



Previous work by one of the authors has pointed out the difficulty of 
pursuing research in the public school evaluation setting.''' In the 1975-76 
school year at the behest of the U.S. Office of Education, the Austin Office 
of Research and Evaluation again attempted to institute a research design on 
a last minute basis in a Title VII bilingual program with equally disastrous 
effects. Teachers and staff rebelled, the treatment was abysmally implemented, 
and the effects were predictable. However, a U.S. Office of Education mandate 
had served as an opportunity that we did not waste. We had begun staff 
development on the whys and hows of research in an all out fashion almost 
immediately upon program implementation and prior to the development 
of a new proposal for the 1976-77 school year. We designed a "one-hour 
course" with transparencies giving the minimum basics of research design. 
This served to instruct participants on why our design required certain 
program characteristics and imposed certain program constraints. This 
workshop was presented to program staff, administrators, and principals involved 
first. This was then followed up with a meeting with the teachers and other 
staff at each school involved in that program. A sell-job on the benefits 
of research design was also included. But most importantly teachers and 
staff were invited to first nominate and then elect a research topic they 
considered essential to bilingual education. 
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Finally, the topic of field trip experiences emerged as their preferred 
topic. Teachers felt field trips provided important experiences for their 
students, but the question often arose, "Do they really enhance student 
learning?" The question was further elaborated. "Do field trips alone 
produce learning gains as well as a field trip experience carried out with 
a curriculum based on that experience?" The proposal for the 1976-77 school 
year was developed around these questions. Coincident, of course, were to 
* be questions on the quality and use of the developed curriculum materials. 
Since in general specific materials for bilingual instruction of dialect-specific 
groups are lacking, the materials themselves were most important to the overall 
program design. 

A strong motivator for good implementation of this new design developed 
when the evaluation report for the first school year, 1975-76, came in. 
The report was so negative, reporting in fact only minimal implementation and 
no positive results, that school board, community, schools, and administrative 
staff were spun into an uproar. Initial reaction, of course, was to criticize 
the evaluation, but when the dust settled, the staff and schools were strongly 
feeling the pressures of accountability. They became more united and went into 
the 1976-77 program with an aggressive attitude toward succeeding. 

This paper will report on the project's improvements in implementation 
for 1975-76 ani the result outcomes. Process evaluation from 1976-77 indicated 
that there was a treatment which did produce effects. The design was a fairly 
complex one necessitated by the public school constraint that no child ever 
be denied "the benefits" of a program. This experimental design will be 
described in detail. Some continuing illustration of the public school 
evaluators dilemmas in not being in command of the treatment will also be 
illustrated in a second aspect of the program, parental involvement. 
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CAN RESEARCHERS FIND TRUE HAPPINESS IN A i^LIC SCHOOL SETTING? 
A SUCCESS STORY IN BILINGUAL EDUCATION EVALUATION 



U pwdixoZivz KQMQjviQk po4>4>ibl2, in a public 4>(ihool 6eXting? Can 
thz natuJuxZ conflict boJwdzn oKltYvtzd school pzn^onmt 

and xuzoAcJi oKlznZzd evaZiJuxtox6 be /lUolvzd? Thz ESEA TiXZz Vll 
KLUngujot Pnogmn Zn Austin, Texcts ha6 zncjoantVidd both ioAXwiu 
and 4acce64e4 in zhU cjizol. TheAX_Qxp^/Uzncz6 oaz pn,t6eMzd 
/le/te to IttuMtAatiL that tt ^ po66AJblz to de^^jgn /i^^eoAch ojwund 
thz con6tAjtLnt& zncountoAzd aji the. pabtai 6ckool6. 

The, mAAotive o^ thU papeA l6 mAjUen a poAablz; hcvoeveA, 
the, evejtt6 Ae,pn,eMej/vte,d keAe, oaz ba6zd on actuat happesiLng^. 
Appzndice^ oaz attached to paovaAz thz AeMeA tjotth de^luiUlon^ 
oi thz tAixz voAAjxhle^ and deMcxiptlon^ oi the, AeMuJiU obtcUnzd. 

Long before humans learned to jspeak, there lived a tribe of people^ 

who communicated exclusively by manipulating the fingers on their right 

■hand. Because of this, everything in their society was designed to be 

worked using the right hand. The schools were right-handed, and the jobs 

available for graduates were right-handed. Justice in this country of 

Derecha, though even-handed, was on the side of the right ior that was 

\ 

their manifest destiny. 

As one might expect, everything was too good to be true, for the 

i 

country to the south, Izquierda, was a left-handed country. Eventually, 
Izquierdans began moving into Derecha and joining other Izquierdans who 
had lived in the south of Derecha since it haS been taken over from 
Izquierda generations before. 

No longer could Derecha just ignore the left-handed communicators 
among them. The children of these native left-handers frequently fell 
behind their right-handed classmates in school. For years anyone commu- 
nicating from the left had his hand slapped. The Izquierdan-Derechans 
right-handed communications were definitely affected by their left-dominant 
background. Their fingers slanted to the left even when communicating 



with their right hand. Derechana complained that Izquierdans moved the 
fingers of their left hand so fast that they could not even understand 
the few words they knew from the left. 

Eventually, the growing number of the left-handed communicacors and 
their right-handed sympathizers who could see bo^h sides of the issue 
mustered enough political power to pass new laws to aid the education of 
chJZdkzyi ivko oAz tatUXzd ^ht-hand cDmusujiation ahULLty 04 a /lOMxtt 
0^ coming a ^amliy backgxo'jnd arfio4e domimnt hand i6 Iz^t. These 
laws provided not only new and exciting jargon, such as, mono-mano for 
only knowing how to communicate wi th one hand and bi--mano for knowing 
how to communicate with both hands, but also great sums of money to fund 
new educational programs. 

Even though the grants were being awarded hand --over-fist, the left- 
handed children were not learning to us^ their right hands very fast. 
So, 'the lawmakers issued a mandate to all bi-mano education projects that 
they were to become demonstration projects and not service projects. In 
order to receive a hand-out for bi-mano education, a project roust hire 
a seeker of truth (or contract out the truth seeking to a reputable firm) 
and perform the dreaded ritual of truth seeking. 

The manualists (teachers) and managers (principals) knew what this 
meant. No longer could they receive great sums of money and ser^e everyone 
in their schools. They now had to give some students special materials 
and services and deny these to the poor students who would fall into the *^ 
often fatal control group. 

The conflict had begun. On the one hand, there were the manualists 
wanting only to care for all the students without the bother of following ' 
a truth-seeking design. On the other hand, there were the truth-seekers 
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who were determined to implement clean designs with random assignment in 
the beginning rather than random results in the end. Was a solution even 
possible? 

The truth-seekers were clever enough to pick up on some of the 
mariualists' concerns, especially the one about serving some students and 
not serving others. So the first truths-seeking design tried was one in 
which two different treatments were compared to each other rather than 
having a treatment group and a deprived control group. In addition, the 
truth--seekers schemed to avoid some fist waving by focusing the treatments 
on the manualists and the children's parents rather than directly on the 
1 children. After all, in Derecha a truth-seeker should not only manipulate 
the variables but *also vary the manipulators. That way everyday manip- 
ulations in the classrooms would be affected only indirectly. Foolish 
those truth-seekers wer%! This backhanded approach was too thinly gloved 
to slip' by unnoticed. 

However, the first year truth-seeking designs were finalized in a 
great meeting between the truth-seekers and what must have seemed to them 
tp be the rest of the world H<(manualists, managers, and other administrators) 
The school personnel agreed to two truth-seeking designs, one for manu- 
lists and one for parents, even though they were overwhelmed by all the 
truth-seekers ' technical terms. Even the promise of fia^tastic analyses 
using the latest digital computers sounded sinister to them. 

Figure 1 outlines the truth-seeking design for the manualists. 
Two exercise programs to aid their classroom manipulations were planned. 
One program was to train manualists individually using the results of a 
Manualist Competency Test (MCT) to identify training needs. The other 
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Figure 1. TRUTH-SEEKING DESIGN - YEAR 1 

J 

program was to train manualists more traditionally in large groups using 
Che results of the MCT to iden^:ify the most evi4ent group needs. In the 

end, the exercise program that had the more positive effect on manualists' 

I 

skills with both the right and the left hand would be determined. 

Figxire 2 shows the truth,-seeking design used with parents. The Bi- 
Vlano Project had hired a community handmaiden to work with each school. 
These handmaidens were to work with one third of the parents individually, 
one third in groups dt the school, and one third in no ijpecial way. The 

amount of participation in school activities, the parents' attitudes toward 

/ 

school, and the parents' knowledge of school activities were all to be 
measured carefully by the truth-seekers* 
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Figure 2. TRUTH-SEEKING DESIGN FOR PARENTS 
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The school year could best be described as tumultuous. The managers 
and manualists resented having truth-see)cers scrutinize their' every move- 
ment when the regular mono-mano school manipulations were never besought 
for so much information with which to be called up for the dreaded ritual 
of accountability. When the school board performed that ritual on the 
Bi-Mano Program, everyone threw up his hands ir resignation (emotional 
not ^political) . The seekers reported^that the individualized and group' 
exercise programs had looked so identical to them that they could not 
tell them apart. There were no differences between the two treatments; 
however, manualists in both- had become significantly more nimble as 

measured by the MCT. Since no differences were found between the treatments 

i 

the relative effects of the two were not investigated for student out- 
comes . J 

The parent design proved to be equally unproductive. The handmaidens 
neld very few individual or group training sessions. In these sessions, 
the main activities were handicrafts rather than information dissemination. 
The fev parents with which' they worked wer.-* sampled and interviewed by 
assistant truth-seekers, no real differences were found between parents 
who were individually and parents who were'^group contacted. 

What a disaster. The school people were upset, the school board 
members were disappointed, the truth-seekers were frust^^rated, the executors 
of the government money were casting wary eyes, the left-handed dominant 
students were no better off, and the Izquierdan-Derechans still could not 
shout "hooray for our side." 

f 

The truth-seekers knew something drastic had to be done and quickly. 
Analyzing the situatipn, they i^ntified the constraints that were hand- 
cuffing their efforts. 
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Mo student could be denied a treatment even though chat 
p treatment's benefits may be untested^ By the end of the 

year, every student should have received the same "benefits*" 

vjW) Schools were too different and too few (nine) to be randomly 
^ f^j assigned to treatment groups without risking having nou- 
equivalent groups ♦ 

School personnel did not want to be split up into groups, 
\jj but if they must be, they wanted to keep at least trvo 
consecutive grades in the same groups, e»g., K-L, 2-3, 
4-5 • 

The treatment selected had to be acceptable to the aian- 
\lJ ualists, preferably hand-picked by them. 

^\|\/]y| Th'e school personnel had to be ^taught the necessity of 
/ following a proper truth-seeking design to confidently 
\^ test a hypothesis. Terms, such as, random, significant, 
comparison/control group, etc., must be understood. 

With these in mind, the truth-seekers plotted, and a plan was devisea 

by which school personnel would be Led by the hand through a training 

minicourse in truth-seeking designs, a brainstorming session, and a decision 

making session to develop an acceptable design. The steps followed were... 

Luncheon at an Izqiiierdan restaurant with top administrators 



:nd managers to present a 30 minute minicourse on truth- 
seeking* 

a. Random assignment 

b. Probability 

c. Significance 

d. Control groups/alternate treatments 

e. Common designs (many years later published by 
Campbell and Stanley) 

Brainstorming with the administrators and managers all zhe 
questions to which they would Like to see answers sought. 



% 

\^ Repeating and )^ 

f 



for the manualists. 



Preparing several possibie designs from which a bi-mano 
education task force could choose the one which was most 
important and moct closely fit their constraints. 

Finalizing the design with the task force and submitting 
it to the government executors for approval. 
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The resell t was the handsome truth-seeking design presented in Figure" 



'3. The task force chose first-hand field experiences as their area of 
greatest interest. The questions posed were: 

What are the effects of activity-orienced, experience- 
based learning experiences on a left-hand dominant child's 
manipvilative skills? 

What are the effects cf activity-oriented, experience- 
based learning experiences conducted by a trained man»ialist 
using prepared exerciser as cdiapared to those conducted 
by aa untrained manuaiist without prepared units? 
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Figure 3. TEUTH-SE'FXDIG DESIGN - YEAR 2 

The key^ characteristic of the design was that all students would be 

allowed to participate in the field experiences before the end of the year. 

Two consecutive grade levels ac eaca school were ^assigned randomly to each 

of three treatment groups. 

'"■i ll Treatment , Mauualists were t^rained, units .v-ere 
provided,^ and field experiences were conducted prior 
to posttesting (five moons aft^r the start of the 
school year). 



Partial Treatment . Manualists were :iot trained, unit 
were not provf ded, ^but field experier^ces were taken 
prior to posocesting. 
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Delayed Treatment s Manualists were trained, units were 
provided, and field experiences were taken after post- 
test ing* 

A domain-referenced test was developed around the manipulations (both 
left-handed and right-handed) which the students would encounter during 
their field experiences ♦ 

The majorhandicap of this design was that no long-term effects cculd 
be measured- since, by the end of the school year, all students would have 
received similar treatment. 

The design for parents was left unchanged for this second year. 
Unsurprisingly, no significfant differences were observed the second year 
either. Implementation levels had been about the same, very low, both 
years . 

On the other hand, however, the results from the experience-based 
activities were both statistically and educationally significant. The 
students in the full treatment consistently outperformed students in the 
partial treatment group. The students in the partial treatment group 
outperformed the students in the delayed treatment group at one of three 
levels. The advantages were evident in both left- and right-handed com- 
munication skills. The treatment had won hands down. 

Everyone was happy. The manualists had successfully taught their ^ 
students the desired skills, and the truth\seekers had successfully 
implemented a rather complex design within the constraints of the public 
school setting. 

1 

All that is left is the morax of our story. 

A 4eefeeA i/imth can {yind happAjKU,^ in a pabtLd school ^^Xting 
ii the, corUitAaiyvU ike, ^XMmtion cuie. con^ideAed and atczptzd 
bzion^zhand. Injuutk-^zeklnQ and zdixaation can go hand-in-hand, 
'4^om2Ximc6. 
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ATTACHMENT 1 



ASSESSING COMPETENCIES REQUIRED 
FOR TEACHING IN A BILINGUAL 
PROGRAM 
1975-1976 



The MCT referred to in Figure 1 represents the Teacher Competency Test 
(TCT) used to measure teacher acquisition of knowledge from inservice 
training sessions conducted by the ESEA Title VII Bilingual Project. 
Only knowledge competencies were assessed with this paper and pencil 
instrument. 

Because actual differences between the two treatments were small, no 
comparisons were made of the two. However, pre to post changes were 
measured and are reported here in Figure 1-1. As is evident from 
inspecting the data, the general direction of change for the individual 
competency areas was -positive. Overall, ^the." teachers did demonstrate 
significant gains in competency, probably as a result of the inservice 
training provided by the Title VII Bilingual Project. 

Figure 1 in the narrative is an accurate depiction of the assignment 
of teachers by grade level teams within schools to the two treatment 
groups defined below. 

Model I - Teachers were administered the TCT; individual 
profiles were provided to each and to the Title 
VII staff to be used in planning and conducting 
individual training activities. 

Model II- Teachers were administered the TCT; group profiles 
were provided to each and to the Title VII staff 
t to be used in planning and conducting group train- 

ing activities. 
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Cooparison or Pre and Post Teacher Cu-ap^tancy tesc Scores 
for Model I and Hodcl It Taachars 



Suaber of Mode- I Teachers • 57 
Mumber of Model II Teacners • 58 
Scoring Procedure: ' Area of Strengch « 2 points 

Area for Reinf orcemenc • I poinc 
Area for laprcvemenc » 0 point 





COMPETENCY" 


TreaD&ent 


Pretest 
Moan 


P0Stte:3C 

Mean 


Direction 
Of change 


Probabiiicy Pre 
and Post are 
the same 


I. 


^^•iu9[i SIC am 
Coai>cehension - Sianla 


Model I 
Model XI 


L .54 
i.74 


1.77 
1.69 




.0058 
.5601 




Cooprehf4ision - Interaediate 


*loaei 1. 
Model II 


i .0^ 
1.29 


1.39 
1.26 




.0018 
.7102 


3. 


Ins traction 


Model I 
.^odel il 


1. 44 
1.55 


1.53 
1.72 




.3229 
.0733 


4. 


and Scope 


vr<i^ a1 t 

oonei X 
Model II 


.98 
I.IA 


1 . 19 
1.19 




.0207 
.5222 


5. 


Scg lish/S p^inish 
Interface Phonemes 


jioaex 1 
Model n 


L . ; J 
1.24 


1,39 
1.40 


+ 


.0066 

.l<?84 


6. 


Second Language 


.^nex 1 
Model II 


1 no 
1 .U? 

1.17 


1.17 
1.12 


4. 


.4339 
.6629 


iT 


Use of a 

3ilini{ual Aide 


jiocaJL i. 
Model II 


L . 77 
1.72 


L .82 

1.74 




.^785 
.8313 
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!fad of rh* 

Coonunity Represent a tive 


Model I 
Model 11 


1 .03 
1.02 


1. 19 
1.22 




.4610 
.0991 


9. 


Mexican- Aae ri can 


Model I 
Model ri 


1 . 21 
1.31 


L .33 

i.4l 


4. 


.1599 

.3362 


10. 


rtjg-^ j^i rwTi u ^tucenc 
to Reeding Program 


Model I 
Model II 


.89 
1.14 


.36 
1. 10 


- 


.7532 
.7879 


11. 


C<3flDiin^ CAT i onv ^riPh 

>«WHUU4^W4 U ^ U 149 ^ W U 

Title 7X1 Staff 


VfM#4 ml T 

AOuex 1 
Model II 


. 77 
.34 


.93 
.36 


4. 


.0796 
.3689 


12. 


3ilin2tial Education 


Model, i. 
Model II 


1 .03 
1. 10 


L .23 
1.29 


+ 
4. 


.0744 
.0821 




aaxaxng sieaaxng 
Comprehension Levels 


Model I 
Model 11*"^ 


1 .53 
1.72 


1.72 
1.79 




.0193 
.4243 


u. 


Hanaizcment 


noaei, I 
Model II 


L . 44 
1.41 


L .56 
1.52 




.1051 
.1056 


15. 


ISX Scorrnn/ Record i^ff 
Errors 


nooex 1 
Modal H 


1.17 


1 .24 
1.19 




.8313 
.3435 


IS. 


Tiae to 3egxn 

Second language Reading 


Model I 
Model II 


1.56 
1.65 


L.63 
1.71 


4. 
+ 


.3526 
.6009 


17. 


Second Language 
Acquisition Process 


Model I 
Model II 


1.51 
1.64 


1.58 
1.71 


T 


.4031 
.3792 


18. 


Components of 

AISD Title VII 


Model I 
Model IT 


1.75 
1.33 


L.3L 

1.90 




.4785 
.3792 


19. 


OE Oefinition of A 
Bilingual Program 


. Model I 
Model II 


1.61 
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1.71 
1.52 




.1000 
.0800 


20. 


Tests ana 
Measurement 


Model I 
Model ri 
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1.82 
i.77 
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.155j 
.2008 
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Use of Xora 

and Cr-ter^on Te!sc^ 


Model I 
Mfi^ei 11 


1.49 
i.46 


1.54 

1.55 




.5752 

.3603 


22. 


Purpose of Evaluation 
for T^tle 711 ^ 


Model I 

Model II 


1.53 
1.72 


1.63 
1.59 
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.2594 
.1638 


23. 


AISD Evaluation 
Model 


Model I 
Model II 


1.53 
1.43 


.88 
.34 




.0000 
.0000 
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Total Score (out of 
a possible 46 points) 



Total ^fuaber of Individual 
It«a Correctly ^Vaswered- 



Model 


T 


29 


35 


34 


.26 




.0000 


Model 


II 


31 


27 


34 


.53 




.0001 


Model 


I 


50 


54 


54 


12 




.0003 


Model 


II 


52 


55 


54 


72 




.0226 



Figure 1-1. 



COMPARISON OF PRE AND POST TEACHER COMPETENCY 
T&ST FOR yODEL I AND MODEL II TEACHERS. 
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ATTACHMENT 2 



PARENTAL INVOLVEMENT STRATEGIES 
1975-1976 



The parent research design referred to in Figure 2 is an accurate depiction 
of the assignment of parents of ESEA Title VII Bilingual Project students 
to treatment groups. The community representatives hired by the project 
were to have worked with the parents in the manner described below; however, 
very few individual and group activities were conducted. 

Model 1 - Parents were to be contacted and trained individually 
by the community representatives. 

Model 2 - Parents were to be contacted and trained in groups by 
the community representatives. 

Model 3 - Parents were not to be contacted by the community 
represfeatatives . 

The dependent variables measured to determine the effects of the three 
treatments were (1) parent attitudes toward and knowledge of school 
activities and (2) parent participation in school activities. 

Figure 2-1 shows the responses of parents to the fifteen items on the 
interview form. An analysis of variance among the groups of parents 
interviewed showed very few significant differences and no stable trend 
favoring one group over the others. The treatments seemed to have 
equivalent effect (or lack of effect) upon parental attitudes and 
knowledge levels. 

Figure 2-2 shows the number of times a parent from each of the three 
treatments participated in a school activity during the year. A Chi 
Square analysis revealed a significant difference among the total 
number of visits for the three groups. The parents in Model 3y no 
contact or training, actually participated less frequently. This 
could mean that contact between a community representative and a parent 
can produce more frequent parent participation in school activities. 
Since no differences were observed between the parents who were 
individually contacted and those who were group contracted, a bilingual 
project might opt to bypass the more expensive and time-consuming 
individual contact in favor of the more efficient group contact activities. 
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Xc«a 


Mean Responses 


Probability 


Group 
1 


Croup 

2 


1 Croup 
1 3 


jail grouDS 
[are eaual 


^» Incorrect !• Correct 

1. Whit Is 's teacher's aaiae? 

2* Whac is 's ceacher aide's aaae? 
3, Whac is '3 principal's aaat? 


. 9259 
. .25^3 
.7037 


. V 1 5 
. .5332 
.3333 


.9130 
.2174 
.7391 

f 


.9365 
• .0131 
.5603 


1- N'evtr - 3- SometiJBcs 

2- Seldom 4- Often 

4, Do you chack to sea if has any hooeworic 

axid make sure thac ae/six« does ic? 

5, How often do you discuss »s school vork 
with bla/her? 

6, Do you discuss with other parents the things 
happenning at 's school? 


3.6923 
3.5769 

2.3346 


1 
1 
1 

1 3.5455 
3.7325 

1 3.0417 

\ 


! 3.6364 

1 . ...^ 
3.4j4:> 

2.21Ti 


.3235 
. J122 


> JuJC when a^Jcad 2» Whenever they wane to 

7, How aany ciaes have you visited »s school 
since August, 1975? - Mother 

8, How aany tlaes have you visited 's school 
since August, 1975? - Father . 

9, Do you chink parents should visit their 
childrens school whenever they want to or just 
when asked to cone by the principal, counselor, 
or teacher? 


f 

6.4444 j 9.0000 
2.4545 j 2.0000 

1 

1.888<> 1 1.9167 


4.0000 
.3JLS2 

1.9565 


.1331 
.1784 

.3905 


1- iiever 3- Most of the ciae 

2" Some tlaes 4« Always 

10. Do you discuss 's report card with hia/her? ' 

Ix, Do you read the letters and notices sent home 
by »s school? 


3. 3300 
3.3519 


3.5652 
3.9565 


3.7273 
3.9130 


.::s9 

.4042 


1- No 2* Yes j 
12. Do you think th^t letters and notices sent home 1 
by _ 's school should be in both English j 
and Spanish? 


i 

1.3600 j 2.0000 

j 


1.9130 


.J519 


1- 5iot at all 3- Some 

2» Very little 4- Very aiuch 

13, How well do you feel you understand Bilid^ai 
Education? 

14. Hcrr auch do you approve of Bilingual Education 
for ' 


3.1111 
3.7773 


1 

3.1250 
3.3333 


3.1313 
3.7826 


.9496 
.9:31 


1- .No 2- Yes 

15. Prior to today, has *«• school Inxoraed 7ou 

about Che Bilingual program and whac is doxng? 


1.3462 


1.5957 


1.7273 


.4305 


Group 1 » Students whose parents vere actually visited and/or concacted personally 

by the Cotnmunuty Representative. 
Group 2 • Students whose oarents actually attended a group aeecing and were coacacted 

only by written ao':ices. 
Groun 3 » Scudencs whose parents vere not contacted by :he Cotsaunicy Represencative . 
Group 4 « Scudencs randomly selecced from Model I. 
Group 5 * Studencs randomly selected from Model II. 
Group 6 m Scudencs randomly selected from Model III. 



Figure 2-1. COMPARISON OF TREATMENT GROUP RESPONSES . 
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Group 


Ciroup 

3 


Group 


are ecual 




0* Incorrecc !■ Correcc 










1. 


Vhar is 's :eachcr»3 aaiae? 


.?I30 




1 . 0000 


.13:^1 


2. 


Vhac is *s ceacher aide's aane? 


. .2609 


.3929 


.3333 


.6252 


3. 


Vhac is 's orincipal's tiamt? 


.£6^6 




. 551^ 






1« Mev«r 3» Someciaes 












2« Stldom 4« Often 










<4 m 


Do you check co $e« if has any hoaework 
and sake sure chac he/she does i^? 


3.6364 


3.2'^00 


3. '600 


.0731 


5. 


Hov often do you discuss »s school vork 

•^ch hia/her? 


3.7600 


3.6a2<? 


3.8143 




6. 


Do you discuss vith ocner parents che things 
happenning ac *s school? 


2. '.000 


-» ^ '5923 


2.535' 


.6322 



1» Jusc when asked 2» Vhenever they wane co , 

How aany ciaes have you visited »s school i 

since August, x975? - Mother 
How aany ciiaes have you vasiced *s school 

since August, 1975? - Fathar 
Do you think perents shoU.d visit their 
childrens school whenever they vaat to or just 
when asked to come by the principal, counselor, 
or teacher? 



3.7895 j 5.2105 j 4.0526 j 

.9231 ; 1.5000 I 2.4167 j 

I I ■ 

1.3400 ' 1.3839 I 1.9643 

! 

i ! 



1« Never 

2» Soofttioes 



10. 
11. 



3« Most of t.he tiae 
4« Always 



Do you read the letters and notices sent home j 
by »s school? 



3.7391 ; 3.3600 ! 3.3846 
3.7600 I 3.7357 ! 3.3929 



.4105 
.3129 

. 321S 



.0332 
.4736 



1- No 2- Yes 

1^4 Do ycu think that letters and notices sent home 

by ^ *s school should be in both English 

and Spanish? 



:.0OOO i 1.9236 I 1.3929 



1- Net at all 3- Some 

2» Very little 4« Very auch 

13. How well do you feel you tinders tand Bilingual 
Education?* 

14. How Such do you acprove of Bilingual Education 
for ? 



3.0300 
3.3333 



3.1111 
3.7^57 



3.0714 
3.3571 



1- Mo 
Prior to today, has 



2- Yes 

's school informed you 



about the Bilingual prograa and what is doing? 



1.6400 I 1.7308 



1.6786 



2S09 



.9S42 
. "344 



Group 1 ' Students whose oarents were actually visited and/or contacted personally 

by the Cotraaunuty Representative. 
Group 2 Students whose parents actually attenaed a group sieeting and were contacted 

only by written notices. 
Group 3 - Students vnose parents were not contacted by the Community Reoresentative* 
Group 4 « Students randomly selected from Model I., 
Group 5 « Students randoaly selected from y.odel II. 
Group 6 « Students randomly selected from Model III. 



Figure 2-1. COMPARISON OF TREATMENT GROUP RESPONSES 
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IS 



Icem 


Mean Responses 


Probability 


Group 
1 and 4 


Group 
2 an,'< 5 


i vroupjft: S.-ouos 


0« Incorrecc !• Correct 

1. Vhac is __ '5 c««cher's name? 

2. Whac is 'a teacher aide's name? 

3. What is principal's name? 


.9200 
. .2600 
.7300 


1 

. 38^0 
L .4308 
.7335 


. ?600 
.2^00 


.?736 
. .0321 


1- flever 3- Someciaes 
2» Seldom 4« Ofcen 

4. Do you check co see If has any homework 

end make sure chac he/slie does ic? 

5. How oftin do you discuss ,s school wo-k 
wlch hia/her? , / 

6. Do you discuss wit'n other parents the things 
happening at '3 schodi? 


3 . 66o7 
3.666; 
2.3922 

1 


3.3830 
3.7059 
2.3600 


3.7021 
3.6531 
, 2.3922 


.1:93 

. 9113 
.0512 


1- Just when asSc«d 2- Whenever they want to » 
7. How aany tices have you visited .3 school ^^aa 

since August, 1975? -Mother | o.vSlx j 6.7.->00 

3. Hov aaay tiams have you */lsited »a school | ; 

since August, 1975? - Father 1 1.5250 j 1.6500 
9. Do you think parents should visit their | 1 

childrens school whenever they want to or Just | , ,.5, \ , on^n 
when asked co come by the principal, counselor, ' ' ° 
or teacher? j 


4.0286 
1.6522 
1.9608 


.0997 
.998<5 
.4359 

1 



12. 



2- Some tines 4- Always 

Do you discuss '3 report card with hia/her: 

Do you read the letters and notices sent home 
by 's school? 

1- Mo 2m Yes 

Do you think that letters and notices sent home 

*3 school should be in both English 

and Spanish? 



3.3125 I 3.4533 
3.0O77 i 3.3627 



I 

1.9'796 1.9608 



3.8125 
3.90ZO 



1.9020 



.0124 
.4343 



.1933 



1- Kot at ail 3- Some 

2- Very little 4- Very much 

How veil do you feel you understand Bilingual 
Sducacion? 

How much do you approve oc Bilingual Education 
for ? 



3.0962 
3.3039 



3.1i;6 
3.3077 



3.1200 
3.3235 



.9374 
.9:37 



1- 2- Yes — 

15. Prior to today, has '3 school informed you 

about Che 3ill.nguil progran and what is doing? 



1.7451 



1.7143 



1.7000 



Group 1 ■ 

Group 2 • 

Group 3 ■ 
Group 4 ■ 
Group 5 ■ 
Group 6 a 



.3775 



Students vhose parents were actuallv -rLsited and/or contacted personally 
oy t.ne Communuty Representative. 

Students whose oarents actually attended a group meeting and were contacted 
only by written notices. 

Students whose parents were 'act contacted by the Community Representative, 
students randomly selected 5rom Model I. 
Students randomly selected from .Model II. 
Students randomly selected from Model III. 
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ACTIVltY CATEGORY 


Model 


NUMBER OF PARENTS 
1 Model ,2 Model 3 


CHI 
SQUARE 


P 


Instructional 


20 


15 


13 


1.625 


.4477 


Material Preparation 


> 

20 


- 22 


13 


2.436 


.2958 


Field Trips 


25 


30 


23 


1.000 


.6126 


Program Preparation 


8 


10 


8 


.308 


.8580 


Supervision 


10 


15 


3 


7.786 


.0202 


Parties 


37 


38 


38 


.018 


.9918 


Visitation 


56 


47 


32 


6.533 


.0373 


Conference 


351 


342 


344 


.129 


.9371 


Total Number of 
Visits 


608 


593 


521 


7.537 


.0228 



Figure 2-2. COMPARISON OF PARENT PARTICIPATION LEVELS AMONG MODEL 1, 
MODEL 2, AND MODEL 3. 
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ATTACmffiNT 3 

EXPERIENCE-BASED CUmCULUM 
1$76-1977 



Figure 3 accurately describes the assignment of teaching teams to the 
three Er^erience-Based Curriculum (EBC) treatments. The three treat- 
ments compared are described below. 

Full Treatment - Teachers were trained to use the experi- 
ence-based instructional units developed 
by the ESEA Title VII Bilingual Project 
and students participated in field 
experiences prior to posttest date. 

«» 

Partial Treatment - Teachers were not trained and units were 

not provided, but students did participate 
in field experiences prior to posttest 
date. 

Delayed Treatment - Teachers were not trained, units were not 

provided, and students did not participate 
in field 'experiences prior to posttest 
date; however, all of the above were pro- 
vided after the posttest date. 

The ESEA Title VII staff developed six curriculiim units to be used in 
the project classrooms in conjunction with field trips. 

1. Nurseries (plants) * 

2. Circus 

3 . Trains 

4. Banks 

5. Printers 

6. Airports 

A regression analysis was conducted to determine if treatment was a 
significant predictor of students* scores on the domain-referencad 
Experience-Based Curriculum Test (EBCT) , a vocabulary instrument based 
on 'the EBC. The starting model used was as follows. 

EBCT EBCT 

Posttest ' Pretest Treatment + Error 
Each reduced model was as follows. 

EBCT EBCT 

Posttest ' Pretest Error 
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Two treatments were compared with each F test. Figure 3-1 summarizes 
the results obtained. Full treatment groups consistently outperformed 
both delayed and partial treatment groups. Partial treatment subjects 
outperformed delayed treatment aubjecti? on lej^eLone-of the EBCT. ' 

Figure 3-2 is a set of graphs which provides "he acWxal mean scores for 
the students tested plotted to sliow pre and post relationships. 



ERLC 



Vnr lflbl c 
Spaniel 



Engl 1 tilt 
ItemH 



Total 
Score 



Full TreatMStt va 
Delayed Treatment 



r - I. 01 
P - .3176 
(Neillter) 

F - 92.51 
P - .0000 
(Full) 

F - 32.59 
P - .COOO 
(Full) 



2-3 

F - 10.74 
P - .0015 
(Full) 

F - 2.42 
P - .1163 
(Neither) 

F - 10.35 
P - .0018 
(Full) 



4-5 



F - 14.75 
P - .0003 
(Full) 

F 95. B8 
P - .0000 
(Full) 

F - 60.92 
P - .0000 
(Full) 



K-1 



Full Trcjitwent va 
Partial Treatment 

2-3 



4-5 



F - 2,\fi F - 4.60 F - ia.90 
p'- .1355 P - .0305 P - .nbOl 
(Neither) (.^ull) (Full) 



F - 13.64 
P - 0005 
(Full) 



F - 0.81 
P - .3711 
(Neither) 



F - 113.36 
V - .0000 
(Full) 



K - 0.64 F - 3.93 F - 77.22 
P - .4293 P - .0451 P - .0000 
(Neither) (Full) (Full) 



Partial Treatment 
va Delayed Treatment 



K-l 

r - 7.47 
P - .0066 
(Partial) 

F - 32.37 
P - .0000 
(Partial) 

K - 26.08 
P - .0000 
(Partial; 



2-3 

F - 1.69 
P - .1913 
(Neither) 

F - 0.17 
P - .6802 
(Neither) 

F - 1.09 
P - .2982 
(Neither) 



4-5 



F - 0.02 
P - .8719 
(Neither) 

F - 0.17 
P - .6829 
(Neither) 

F - 0.161 
P - .6912 
(Neither) 



Treatment identified in parentheaea t.sd ttie higher predicted poetteat acores when prcccat scores vera used as a 
covar lable. 



Figure 3-1. REGRESSION ANALYSES RESULTS - EXPERIENCE-BASED CURRICULUM TEST 
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